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13  ABSTRAC  T 

The  primary  objectives  of  this  paper  are:  (1)  to  present  a  simplified 
"double-pricing"  method  for  solving  the  capacitated  transportation  problem 
by  Lemkfe's  dual  method  which  streamlines  computer  implementation;  (2) 
to  give  a  new  and  efficient  method  for  obtaining  a  dual  feasible  starting  basis; 
(3)  to  give  the  results  of  computational  comparison  of  a  code  based  on  these 
developments  with  two  widely  used  out-of-kilter  production  codes.  In  addition, 
these  codes  are  compared  against  a  state  of  the  art  large  scale  I.P  code, 
OPHELIE/LP. 

The  study  shows  that  the  improved  dual  transportation  algorithm  is 
faster  than  the  out-of-kilter  codes  for  problems  of  up  to  150  x  150  (origins 
x  destinations),  but  tends  to  fall  behind  thereafter.  The  best  of  these 
algorithms  was  found  to  be  at  least  20  times  faster  than  OPHEFIE. 
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1.0  INTRODUCTION 


This  paper  proposes  &  simplified  "double-pricing"  method  for  solving 
the  capacitated  transportation  problem  by  Lemke's  dual  algorithm  [2^]  and 
shows  how  to  streamline  this  algorithm  for  computer  implementation.  We 
also  provide  an  efficient  method  for  obtaining  a  dual  feasible  starting 
basis  that  exhibits  certain  advantages  over  counterpart  methods  that  have 
been  proposed  for  obtaining  a  primal  feasible  basis.  These  methods  can 
oe  applied  to  network  models  by  using  the  technique  in  Wagner  [35>  page  173] 
to  transform  the  network  into  a  distribution  problem.  In  addition,  the 
results  of  computational  comparison  of  a  code  based  on  these  developments 
with  two  widely  used  out-of -kilter  production  codes  is  provided.  These 
codes  are  also  compared  against  a  state  of  the  art  LF  code,  OFHELIE/LP. 

Specialized  methods  for  solving  the  transportation  problem  with  the 
primal  simplex  algorithm  and  with  related  "dual"  or  "primal-dual"  network 
algorithms  have  been  the  focus  of  a  great  deal  of  ingenuity  and  effort 
(See,  e.g.  [2, 3,6,7,9»H>13»li0 ) .  A  method  for  exploiting  the  topological 
structure  of  the  transportation  problem  in  a  dual  context  wa6  first  proposed 
b  Salas  and  Ivanescu  [2,3],  and  later  simplified  and  shown  to  constitute 
a  specialization  of  the  dual  method  by  Chames  and  Kirby  [7] -  The  key 
to  effecting  the  simplif ications  of  Chames  and  Kirby  lay  in  the  use  of 
the  Chames  and  Cooper  "poly-«"  procedure  [6]  for  linear  programming. 

The  motivation  cited  for  the  dual  methods  of  [2,3,7]  was  the  supposition 
that  the  problem's  "supplies"  and  "demands"  may  not  be  permanently  fixed 
but  subject  to  change.  In  such  a  situation,  it  is  useful  to  have  the 
ability  to  begin  from  ar.  optimal  basis  to  a  given  problem  and  proceed  via 
the  dual  method  to  an  optimal  solution  for  a  problem  with  altered  shipment 
requirements. 

However,  to  our  knowledge,  no  efficient  procedure  nas  appeared  in  the 
literature  for  obtaining  an  initial  dual  feasible  basis  for  a  problem  that 
has  not  previously  beer,  solved  under  a  stated  set  of  shipment  requirements, 
"oreover,  the  dual  methods  of  [2,3»7]  make  no  provision  for  accomodating 
t  e  capacitated  transportation  protlem,  in  which  the  varieties  are  constrained 
to  lie  within  stated  bounds.  To  handle  these  more  general  considerations, 
the  standard  procedure  has  been  to  resort  to  te  "out-of-kilter"  methods 


/ 


which,  although  admirably  efficient  for  general  networks,  were  not  origin¬ 
ally  designed  to  exploit  the  special  topological  properties  of  the  trans¬ 
portation  network.  Recently,  however,  iraves  and  Thrall  [12,  p.  272]  have 
specialized  the  out-of-kilter  algorithm  for  the  special  properties  of  trans¬ 
portation  networks. 

In  this  paper  we  present  a  dual  method  cased  on  those  of  [2,3»7]  that 
operates  directly  on  the  transportation  network,  and  which  accomodates  the 
fully  capacitated  problem  (with  finite  and/or  infinite  upper  and  lower 
bounds).  Our  approach  implicitly  relies  on  the  "poly-jj"  procedure  in  a 
manner  analogous  to  that  indicated  by  Charr.es  and  Kirby  for  the  uncapacitated 
case,  but  our  development  for  the  general  capacitated  problem  is  completely 
straightforward  and  requires  no  reference  to  "poly-«"  methods  for  its 
justification.  By  coupling  this  specialization  of  the  "poly-*"  procedure 
with  the  predecessor  and  augmented  predecessor  index  methods  [18,19]  for 
accelerating  the  determination  of  basis  trees  and  dual  evaluators  a  stream¬ 
lined  computer  implementation  is  achieved. 

We  also  specify  a  method  that  gives  a  dual  feasible  starting  basis. 

Our  "dual  start"  method  requires  an  amount  of  computation  somewhere  between  that  of 
the  "northwest  corner"  and  "YAM"  methods  commonly  used  to  obtain  primal 
feasible  starts.  An  important  feature  of  our  method,  however,  is  its 
automatic  avoidance  of  a  smarting  basis  containing  "inadmissible"  cells. 

As  we  show  in  Section  5#  the  "northwest  comer"  and  "YAM"  procedures  may 
actually  select  such  cells  to  be  in  •  starting  basis.  Thus  the  basic  solu¬ 
tions  provided  by  these  methods  may  well  be  "primal  feasible"  only  in  an 
artificial  sense.  The  basic  solutions  provided  by  our  method,  however,  are 
dual  feasible  without  qualification.  [A  dual  feasible  basis  may  legiti¬ 
mately  contain  cells  whose  variables  are  constrained  to  zero,  and  hence 
"inadmissible"  cells,  but  our  method  effectively  bypasses  them.]  3ecause 
large  scale  transportation  problems  encountered  in  an  industrial  setting 
are  typically  quite  sparse  (i.e.,  contain  a  large  number  of  inadmissible 
cells  ,  the  computational  study  in  Section  6  examines  the  effect  of 
proolem  density  on  solution  time.  [Density  is  equal  to  the  number  of  arcs 
in  the  problem  divided  by  the  number  of  total  possible  arcs.] 


2 


2.0  NOTATION'  Aid  FSOHLEM  STATEMENT 


Ve  write  the  capacitated  tra-  sportation  proclem  in  the  fora: 


Minimize  x 


oc 


icM 


ci:*i  3 


(1) 


sub; ect  to 


Z  X  =  a 

lfM  *  (1,2, . . . ,m 

(2) 

-  xi  =  bj 

jcN  =  (1,2,... ,n) 

(3) 

Li^  "  Xij  5  Uij» 

icM,  jcN 

(M 

where  the  coefficients  a.,  b,,  L.  . 

-  J  fsi, 

if  the  are  finite  valued),  and  £ 


are  finite  integers,  and  U^,  are  integers 


T 


(Ways  for  casting  a 


variety  of  network  probli 


icM  if'A 

in  this  formulation  are  giver,  in  32,351*) 

Following  standard  terminology,  the  a.  parameters  are  called  "supplies," 
and  the  b,  parameters  are  called  "demands."  We  associate  these  supplies 

v 

and  demands,  respectively,  with  the  rows  and  columns  of  an  mxr.  transportation 
tableau  whose  cells  contain  the  "cost  coefficients"  c. .. 

A  set  of  m+n-1  cells  of  the  transportation  tableau  is  a  oasis  if  each 
taolea-  row  and  column  contains  at  least  one  of  the  cells  and  if  no  subset  of 
these  cells  constitutes  a  cycle  (i.e.,  has  the  foim  (i. ,i^),  (i0,i,  ,...,(i^,i 


2*  3 


A  cell  (and  its  associated  variable  x_. ^.)  is  called  basic  if  it  is  contained 
among  those  cells  in  the  basis  and  is  called  nonbas i c  otherwise. 

A  basic  solution  is  the  unique  assignment  of  the  values  to  the  x; 
variables  satisfying  the  equations  '2)  and  (3)  that  results  once  each  non- 
basic  x,.  has  been  set  equal  to  or  equal  to  IL  .  (provided  the  vauue  of 
the  relevant  bound  is  finite).  If  such  a  solution  satisfies  (t)  for  all 
of  the  variables,  then  it  is  called  primal  feasible. 

Corresponding  to  a  particular  casis  is  a  set  of  "row  multipliers"  F.^ 
and  a  set  of  "column  multipliers"  Y..  ( not  unique)  such  that  the  "updated 
cost  coefficient"  rr. defined  by  tt^  *  F..  ♦  K,  -  c,  .,  is  zero  for  all  basic 


VI 


'ij' - '  ”ij 

ceils;  a  basic  solution  is  dual  feasible  if  in  addition  n 
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s  0  for  all 


nonbasic  variables  x..  ,  set  equal  to  and  tt.  .  ?  0  for  all  noncasic 
variables  x,  ,  set  equal  to  U^.  (The  multipliers  F...  and  K..  on  which  the 
are  based  represent  values  assigned  to  the  variables  of  the  dual  of 

* 

the  tra:  sportation  problem.)  by  fundamental  linear  programming  theory, 
a  basic  solution  that  is  both  primal  and  dual  feasible  is  optimal  for  the 
transportation  problem. 
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2-0  THE  DC-U5LZ  PHI  DIM  AllGPIPHy 


To  lay  the  foundation  for  specializing  the  Lemke  dual  method  *o  the 
capacitated  transportation  problem,  we  first  review  the  steps  of  the  duel 
method  in  a  general  ( bounded  variable)  minimization  linear  programming 
framework.  (See  Footnote  1.) 

1.  Begin  with  a  dual  feasible  solution. 

2.  Select  a  basic  variable  (call  it  yf)  that  violates  either  its  upper 
or  lower  bound.  (If  no  such  variable  exists,  the  current  basic  solution  is 
optimal  and  the  method  stops.) 

3-  Determine  the  unique  "updated"  linear  equation  which  expresses  the 

selected  basic  variable  y  as  a  linear  combination  of  the  current  nonbasic 

variables;  i.e. ,  y  *  A  +  Tl  X.  (-y.  ),  where  NB  denotes  the  ^ndex  set 
r  o  .  x  x 

for  the  current  non basic  varieties  v,  . 

k 

b.  Let  X’k  =  -Xy  for  kcN3  if  y  is  set  equal  to  its  lower  bound  and 

violates  its  lower  bound,  or  if  y,  is  set  equal  to  its  upper  bound 

and  violates  its  upper  bound.  For  the  remaining  k- Nr,  let  \\  •  Xv  and 
r+  +  x  k 

let  HB  =  {jfNB:  x\.  >0).  If  NB  is  empty,  then  the  problem  has  no  primal 
feasible  solution  and  the  algorithm  steps. 

5.  Identify  the  unique  "updated"  equation  that  expressed  the  objective 
function  variable  to  be  minimized  call  it  y  )  in  terms  of  the  current 
nonbesic  variables;  i.e., 
y  =  tt  +  T, 


k?N3 


"k  "yk} 


Identify  a  nonbasic  variable  y  ,  scNB  ,  such  that 

s 


IV*. I  ■  <IWI> 


(for  kf.ta*,  |-ty\|  *  |t^1  /  \\.) 

7.  Determine  a  new  current  basic  solution  by  removing  s  and  adding  r  to 

NB  (making  y  basic  and  /  nonbasic),  ar.d  assigning  y  the  value  of  the  bound 
s  r  r 

it  previously  violates  while  holding  the  other  nonbasic  variables  constant 
(identifying  the  values  thus  assigned  to  the  new  set  of  current  basic  variables). 
Then  return  to  instruction  2. 

Finiter.ess  of  the  foregoing  method  is  assured  through,  the  use  of  "perturcation 
or  "lexicographic"  schemes  'see  [5»9l)»  Suer  schemes  will  not  be  discussed 
here. 


To  refine  the  general  dual  net hod  to  the  capacitated  transportation 
prociem,  i*  is  important  to  note  that  the  "row-coiumr  sum  'also  called  the 
'ELI  method  [?])  method"  [t,vol.  II]  for  solving  the  transportation  problem 
with  the  primal  simplex  net hod  can  be  applied  to  determine  the  values 
of  Instruction  5  which  correspond  to  the  .  values  indicated  ir.  the 
preceding  section),  and  to  effect  the  "basis  exchange"  step  of  Instruction 
’7.  Thus,  to  complete  the  specification  of  the  dual  net hod  specialized 
to  *.  e  transportation  problem  we  require  a  procedure  for  determining  the  \.f 
coefficients  introduced  in  instruction  3  ar.d  referred  to  in  Instructions 
1  and  6 ) . 


The  close  resemblance  of  the  goals  of  determining  the  ar.i  ).^ 
coefficients  when  the  uuai  me*v.od  is  stated  as  above  suggests  that  the 
procedures  for  achieving  these  goals  should  likewise  be  similar.  Ir.deea, 
the  so-called  "pricxng-out"  procedure  for  determining  the  values  for 
the  transportation  problem  directl  extends  to  a  "double  pricing-o.t" 
procedure  for  Joint  determination  of  both  the  n.  and  X  values. 

In  the  transportation  context,  we  shall  denote  the  .  asic  variable  r 
selected  in  Instruction  2  by  ,  and  represent  the  equation  of  instruction 

3  Vy  KX  I 


rpc  *  Xoo  * 


ioK 


i  *  ”xi ' 

1 1. 


where  X  ^  =  0  if  x. ,  is  uasic).  The  Justification  of  the  following  result 
is  then  immediately  apparent  from  our  foregoing  remarks. 


! emna: 

let  c’  =  1  and  c*  =0  for  all  icM,  JcH,  and  (i,j)  i  rV,<V-  If  R\ 

pC  1 

and  K\  are  row  ar.d  coi-mr.  multipliers  such  that  c’...  =  R*_.  K*.  for  all 

«l  *  v 

: as^c  xt ,  then  the  X^,  values  are  given  by 
X,<  «  R\  ♦  K'  -  *’5  »  1<V»  y*- 

Proof: 

From  the  "row- column  sum"  method,  the  unique  "updated"  equation  ti.at 

expresses  the  objective  function  variable  to  fee  minimized  x  =  S  c.  x 

°°  icK  1J 


ts  a  iir.e&r  combination  of  the  c-rrent  .or.lasic  variables  is  z  =  n  * 

oo  oo 

*t.  .  (-x.  .)  where  -r.  .  *  R.  ♦  K.  -  c.  i«.K,  .1*  \  and  H.  %"1  K.  are  rear  and 
•  y  ij  ij  i  J  U  i 

column  multipliers  such  that  c.  .  =  R.  ♦  K,  for  all  basic  x.  .. 

For  the  costs  c'.  .  defined  above,  x  *  S  c*.  x.,  =  x  .  "onsequer.tly, 
x  :  00  i  Oi  K 

♦£  n‘«  (-V  * *&  ^ 

jcV  jc2f 

where  n* . ,  =  R',  +  K*  .  -  c*.  i*X,  jtN,  and  ?’.  ♦  K’  -  cV.  =0  for  all 

i«j  i  0  -O  i  j  ij 

basic  x. . .  Thus, 
ij 

=  R^  +  K*  -  c'.  .,  ion. 


As  intimate!  earlier,  this  result  constitutes  a  specialization  of  the 
harr.es  pol;  -a  procedure.  A  thoiough  discussion  of  the  poly-®  procedure  in 
a  general  setting  is  unnecessary  to  see  the  validity  of  the  result  ir.  the 
present  application  ar.i  will,  therefore,  ce  edited.  See[,T]  •) 

It  is  also  clear  that  the  "row- column  sum"  rules  for  determining  the  F„ 

and  K.  multipliers  (that  yield  the  rr.  .)  can  be  applied  to  determine  the  R'. 

J  ij  i 

and  K'  multipliers  ar.i  the  P.  and  K.  multipliers  simultaneously.  Morec.er, 
the  topological  structure  of  the  transportation  problem,  ramel  the  triangularity 
property  of  a  oasis,  permits  the  conclusion  that  X. .  =  -1,  0,  or  1  for  all  i.-M, 

WU 

Also,  using  only  the  asis  information  the  X,.  values  can  e  easil *  deter- 
ni.ned  with  a  minimum  amount  of  work,  thus  alle\ iating  the  need  to  update  the 
X. .  values  from  iteration  to  iteration.  Further  the  augmented  predecessor 

•a/ 

index  method  [19]  provides  a  concise  and  efficient  list  structure  for  finding 
the  R'^  and  K*j  multipliers.  The  computer  implementation  of  this  algorithm 
thus  .sec  this  list  structure.  Unfortunately,  even  with  all  these  simplifi¬ 
cations  a  great  deal  of  the  total  cocputatio.-.ai  time  is  spent  determining 

the*  X. ,  values  and  the  n. .  values  ^sed  to  find  the  next  pivot.  This  is  due 

ij  lj 

to  the  large  number  of  these  values  to  be  tour.o  per  pivot:  for  instar.ee, 
if  the  problem  has  10, OCX)  variables  ther  10,000  X. .  values  must  be  determine  1 
on  each  iteration. 
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-.0  COMPLETED  SPECIALIZATION 


To  bring  our  foregoing  comments  together  and  make  then  specific,  we  now 
indicate  the  full  specialization  of  the  dual  method  of  Section  3  to  the  capa¬ 
citated  transportation  problem  in  the  following  detailed  set  of  instructions: 

1.  5e~ir.  with  a  dual  feasible  basic  solution,  denoted  by  x.  .  =  x*... 

Section  '  presents  an  algorithm  for  obtaining  such  a  solution.) 

2.  Select  a  basic  variable  x  such  that  x*  >  U  or  r  <  I  .  (If 

pq  PQ  PQ  pc  pq 

no  such  variable  exists,  the  solution  x.  .  =  x*,.  for  i  ",  jeli  is  optimal  and 

- 

the  method  stops.) 

3.  Determine  the  tt. .  and  \  .  values  simultaneously  by  the  following  rules 

X«3  ■*  J 

for  calculating  the  multipliers  R^,  R'_. ,  K_. ,  and  K'_. .  To  start,  let  Rp  *  R'  =  0, 

\  =  c  ,  Y.'  =  1  and  create  the  sets  ?  =  [p]  ar.i  Q  =  (q( .  In  general,  if  there 

a  pc  q 

exists  &  basic  variable  x._.  such  that  icP  and  jcK-Q,  then  let  K.  =  c.  .  -  R., 

.  =  -R'.,  and  let  C  =  Q  (J  { j J .  Similarly,  if  there  exists  a  basic  variable 

t- 

x.  such  that  z  Q  ar.d  ie> -P,  then  let  R.  =  c.  .  -  K_. ,  R*  .  =  -K*  . ,  ar.d  let 
ij  1  — J  J  1  3 

:  =  P  U  (i  •  Repeat  the  foregoing  until  P  =  N  and  Q  =  M  and  determine  the 
values  tt.  .  =  R.  +  K.  -  c.  .  ar.d  X.  4  =  R’.  +  K’  .  -  c*.  .  for  ail  icM,  where 

aj  i  3  ±1  i  i  iz 

c'..  =  0,  i f,V,  VN,  and  (i,-)  ^  'p,q)  and  c’  =  1.  [The  tt.  .  values  will 
ij  *  pc  ij 

initially  be  known  from  the  algorithm  of  Section  5  for  obtaining  a  basic 
d^al  feasible  start  and  therefore  need  r.ot  be  calculated  on  the  first 
iteration  of  this  step.] 

~.  Let  £  be  a  "flag"  set  which  is  equal  to  -1  if  x*  <  L  and  which 

+  pq  pq 

is  set  ecual  to  +1  if  x*  >  U  .  Then  let  NB  be  the  set  of  cells  (i,j)  such 

pq  pq  + 

t:  at  either  .  =  £  and  x*.  .  =  L.  .,  or  and  x*.  .  =  U,..  (If  NB  is 

i_  —o  - 1  — ^ 

empt  ,  the  transportation  problem  has  no  feasible  solution  and  the  algorithm 


s  —  op  s  •, 


Identify  a  nonbasic  variable  x  ,  (u,v)  f  K3  ,  such  that 

uv 


|n-1  ■  (“W  IKj|1‘ 

6.  Determine  the  unique  c.  cle  created  by  adding  the  cell  (u,v)  to  the 
cells  of  the  basis  (e.g. ,  using  the  predecessor  index  method  of  [18]).  Let 
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9  =  L  -x*  ifx*  <L  and  otherwise,  let  9  =  U  -  x*  .  Beginning  with 
pq  pq  pq  pq  pq  pq 

cell  (p,q),  let  the  new  value  of  x*.  .be  x*.  .  +  6  for  each  odd  cell  of  the  cycle 

and  let  the  new  value  of  x*. .  be  x». .  -  0  for  each  even  cell  of  the  cycle. 

10  10 

Designate  x  basic,  x  nonbasic,  and  return  to  Instruction  2. 
uv  pq 

5.0  ALGORITHMS  FOR  FINDING  A  BASIC  DUAL  FEASIBLE  SOLUTION 

No  general  procedure  exists  for  obtaining  a  starting  primal  basic  feasible 
solution  for  the  capacitated  transportation  problem  or  for  the  uncapacitated 
transportation  problem  when  some  of  the  cells  are  blocked  out  (inadmissible). 

Thus,  when  solving  such  problems  using  a  primal  simplex  approach,  an  artificial 
starting  basis  usually  must  be  enployed.  One  of  the  major  advantages  of  this 
algorithm  is  that  it  is  always  possible  to  find  a  starting  basic  feasible 
solution  for  the  dual  of  such  problems.  Furthermore,  this  dual  start  pro¬ 
cedure  provides  a  basic  dual  feasible  solution  for  a  network  if  the  network 
is  rewritten  as  an  equivalent  transportation  problem. 

To  the  best  of  the  authors'  knowledge,  no  other  algorithms  which  have 
employed  the  dual  method  [2,3,7]  or  related  "primal-dual"  algorithms  [13,1^,15] 
exploit  the  topological  structure  of  the  dual  to  a  transportation  problem  to 
provide  a  dual  feasible  start. 

The  starting  method  we  propose  may  be  described  very  simply  as  follows: 

1.  To  start,  set  R  *  0.  Create  the  set  P  -  {l}. 

2.  Let  T  be  the  set  of  all  admissible  cells  in  the  transportation  problem 

(i.e.,  T  contains  all  the  unblocked  cells  in  the  transportation  problem.).  Set 
K.  =  c^  for  all  (l,j)eT.  Create  the  set  Q  =  {j:  =  c^.  for  all  (l,j)eT)  and 

the  set  B  «  C (1, J ) :  for  all  (l,j)eT). 

3.  Let  Qi  =  (j:  jeQ  and  (i,j)eT).  For  each  ieM-P  such  that  is  non¬ 
empty,  identify  an  index  j*cQ.  for  which  c  -  K.*  =  Min  {c. .  -  K.},  and  set 

1  J  jfo  J 

Ri  =  c1J#  -  KJ#,  P  =  P  U  (i),  and  B  =  B  u  {(i,j*)).  ^ 

h.  Let  P.  *  { i :  icP  and  (i,j)eT).  For  each  jrN-Q  such  that  P  is  nonempty, 

v  * 

identify  an  index  i*  for  which  c.„ .  -  R.„  =  Min  {c. .  -  R.  )  and  set  K.  =  e,  .  -  R. „ 

i*J  l*  id  k  0  i", 


Q  =  Q  U  (j)  and  B  =  B  U  {(i*,j)). 

5.  Continue  executing  Instructions  3  and  ^  until  M  *  P  and  N  =  Q. 
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Lemma: 


When  Instructions  1-5  are  completed,  the  cells  in  B  form  a  basis  and 
the  multipliers  R.  and  K.  defined  above  satisfy  the  following  properties: 

1.  R.  +  K.  =  c. .  for  all  (i,j)  e  B. 

i  J  ij 

2.  R.  +K,  -C..SO  for  all  (i,j)  r  T. 

i  J  ij 

Proof: 

The  method  will  continue  to  execute  Instructions  3  and  4  until  P  =  M  and 

Q  =  N  provided  that  Q.  and  P,  are  not  both  empty  at  some  iteration.  Assume, 

t  j 

however,  that  both  Q.  and  P.  are  empty  at  some  iteration,  then  the  problem  has 
no  basic  solution  except  by  using  an  inadmissible  cell.  This  follows  by  noting 
that  the  stated  conditions  imply  that  the  problem's  admissible  cells  are  all 
found  among  those  cells  (i,j)  for  ieP  and  jeQ  or  for  which  ieM-P  and  jeN-Q 
and  hence  there  is  no  connected  set  of  admissible  cells  that  spans  all  rows 
and  columns.  Thus  assuming  that  the  transportation  problem  is  connected,  the 
algorithm  will  continue  to  execute  until  P  =  M  and  Q  =  N. 

When  the  algorithm  stops,  B  contains  m+n-1  cells  since  one  new  cell  is 
added  to  B  each  time  an  R,  or  a  K.  is  determined  except  for  R, .  The  cells 

i  .1  1 

of  B  clearly  span  all  the  rows  and  columns.  Further,  the  cells  in  B  contain 
no  cycles.  To  verify  this,  assume  the  contrary  and  let  (r,s)  be  the  first 
cell  added  to  B  which  creates  a  cycle  with  the  previous  cells.  Then  there 
must  be  a  cell  (r,j)rB  and  a  cell  (i,s)eB.  But  this  is  impossible  when  (r, s) 
is  added,  since  all  cells  (i,j)eB  satisfy  icP  and  jeQ,  whereas  to  augment  B 
with  the  cell  (r,s)  either  rcM-P  (Step  3)  or  seN-Q  (Step  4).  Thus  B  forms  a 
basis. 

Finally,  the  relations  1  and  2  are  in  immediate  consequence  of  the 

definition  of  the  R.  and  K.  values.  Thus,  the  proof  of  the  lemma  is 

J 

complete. 

[We  remark  that  the  foregoing  proof  also  justifies  a  more  flexible 
version  of  the  dual  starting  method  in  which  Step  2  is  applied  to  only  a 
single  cell  (l,j)cT,  and  Steps  3  and  4  are  executed  in  any  desired  sequence, 
selecting  only  one  index  i  or  j  in  these  steps  in  any  single  execution.  Of 
course,  the  method  can  also  begin  with  a  row  index  other  than  i  =  1. ] 
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From  relations  1  and  2,  the  lemma  implies  that  a  solution  obtained  by  setting 

the  flow  of  each  nonbasic  cell  equal  to  its  lower  bound  L.  .  and  each  basic  cell 

ij 

equal  to  the  unique  flow  specified  by  the  basis  (once  the  nonbasic  cells  have 
been  set)  will  yield  a  basic  dual  feasible  solution.  Furthermore,  the  lemma 
implies  that  such  a  basic  dual  feasible  solution  may  be  obtained  for  any  capa¬ 
citated  transportation  problem  as  long  as  it  is  connected. 

To  illustrate  the  algorithm,  consider  the  uncapacitated  transportation 
problem  in  Tableau  1.  The  numbers  in  the  upper  left  hand  corner  of  each  cell 
indicate  the  cost  of  that  cell.  (If  the  cell  is  blocked  out,  it  is  assigned  a 
cost  of  M.) 

\  -  1  K2  =  -k  K  -  -1  =  5 


hm0 


R2  -  -2 


R3 

ri,  -  9 


lol  * 

“TO 


Tableau  1 


The  R.  and  K.  values  indicated  alongside  the  tableau  are  determined  by 

i) 

instructions  1-5.  The  cells  with  an  asterisk  (*)  in  the  upper  right  hand 
corner  are  the  basic  cells.  The  circled  numbers  in  these  cells  indicate  the 
unique  shipping  amounts  specified  by  the  basis. 

This  example  can  be  further  used  to  illustrate  the  fact  that  employing  the 
usual  techniques  for  obtaining  a  starting  basic  primal  feasible  solution  may  yield 
an  artificial  start. 

In  particular,  applying  the  northwest  corner  rule  and  the  Vogel's 
Approximation  method,  (30],  respectively,  to  the  transportation  problem  in 
Tablear  1  gives  the  artificial  bases  of  Tableaus  2  and  3  below.  (The 
circled  entries  indicate  the  shipping  amounts.) 
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SB 

gg| 

gg| 

sb 

s/si 

Sg 

SI 

S/S! 

S/31 

SI 

gg| 

S/S! 

m 

Tableau  2 


SB 

SB 

gg 

m 

sb 

IS 

si 

m 

g| 

SI 

S/31 

SB 

SB 

10 

B 

6 

12 


Tableau  3 


( .0  CODE  DEVELOPMENT  ML  COMPUTATIONAL  COMPARISON 

( ■ 1  OVERVIEW 

This  section  presents  a  computational  comparison  of  a  code  based  on  the 
above  developments  with  two  widely  used  out-of-kilter  production  codes  and  a 
state  of  the  art  large  scale  LP  code,  OPHELIE/LP.  We  also  examine  the  effect 
of  problem  density  on  solution  time,  where  density  is  equal  to  the  number  of 
arcs  (cells)  in  the  problem  divided  by  the  number  of  total  possible  arcs. 

(The  interest  in  density  is  stimulated  by  the  fact  that  large  "real  world" 
transportation  problems  are  quite  sparse.) 

The  two  out-of-kilter  codes  which  we  tested  are  those  of  SHARE  and 
hoeing.  The  SHARE  code  was  written  by  R.d.  Clasen  of  the  RAND  Corporation 
and  is  available  for  general  distribution  [8,2°].  The  Boeing  code,  which 
was  obtained  through  Chris  Witzgall,  was  developed  at  the  Hoeing  research 
laboratories,  both  of  these  codes  and  the  dual  code  are  in-core  codes; 
i.e.,  the  program  and  all  of  the  problem  data  simultaneously  reside  in 
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fast-access  memory.  All  three  codes  are  written  ir.  FORTRAN  and  none  of 
them  have  been  tuned  (optimized)  for  a  particular  compiler.  All  of  the 
codes  were  run  on  the  CDC  6600  (which  has  a  maximum  memor"  of  130,000 
words')  at  the  University  of  Texas  Computation  Center  using  the  RUN  compiler. 
The  computer  jobs  were  executed  during  periods  when  the  machine  load  was 
approximated;  the  same  and  all  solution  times  are  exclusive  of  input  and 
output;  i.e.,  the  total  time  spent  solving  the  problem  was  recorded  by 
calling  a  Real  Time  Clock  on  starting  to  solve  the  problem  and  again  when 
the  solution  was  obtained. 

The  general  simplex  linear  programming  computer  code  employed  in  the 
study  was  Control  Tata's  OPHELIE/LP  code.  OPHELIE/LP  is  a  subsystem  of 
the  OPHELIF  II  Mathematical  programming  System  which  is  programmed  to  exploit 
the  characteristics  of  the  CDC  6600  computer. 

To  guarantee  a  comprehensive  comparison  of  the  procedures  under 
analysis,  the  transportation  problems  used  in  the  study  varied  between  . 5 
percent  and  90  percent  dense  and  varied  in  size  from  10  x  10  to  500  x  500 
(origins  x  destinations).  A  total  of  65  different  uncapacitated  transpor¬ 
tation  problems  were  examined,  all  of  which  were  randomly  generated  using 
a  uniform  probability  distribution.  The  total  supply  of  each  m  x  m  trans¬ 
portation  problem  was  set  equal  to  1000  m  and  the  supply  and  demand  amounts 
were  picked  using  a  uniform  probability  distribution  between  0  and  2000. 

The  only  other  restrictions  placed  on  the  problems  consisted  of  requiring 
the  number  of  variables  to  be  less  than  or  equal  to  10,000  and  requiring 
the  cost  coefficients  to  lie  between  1  and  100. 

6.2  DOUBLE  PRICING  DUAL  CODE  DEVELOPMENT 

The  computer  code  embodying  the  ideas  of  the  preceding  section  was 
written  in  FORTRAN  IV  and  tested  on  a  CDC  6600  with  a  maximum  memory  of 
130,000  words.  To  solve  a  problem  with  m  origins,  n  destinations,  and 
r  admissible  cells  (without  exploiting  the  word  size  of  the  machine)  this 
in-core  code  requires  3r  +  19m  +  17n  +  20,000  words.  It  would  have  been 
possible  by  exploiting  the  fact  that  the  costs  are  integer- valued,  to  store 
more  than  one  cost  coefficient  per  word  and  in  this  manner  solve  much  larger 
problems.  However,  our  purpose  was  to  develop  a  code  whose  capabilities  did 
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not  depend  on  the  unique  characteristics  of  a  particular  computer  'e.g. ,  word 
size,  etc.)*  To  permit  the  solution  of  large  problems  we  organized  the  code 
to  utilize  a  "packing"  scheme  which  stores  only  the  "real"  costs  of  the 
transportation  matrix  (i.e.,  only  the  costs  of  the  admissible  cells).  Thus 
for  a  200  x  200  problem,  with  10  percent  density,  this  approach  stores  only 
U,000  of  the  ^0,000  elements  stored  by  standard  schemes.  The  more  economical 
storage  scheme  incurs  a  time  disadvantage  in  packing  and  unpacking  cost  coef¬ 
ficients,  but  materially  reduces  the  number  of  updated  costs  that  have  to 
be  computed  for  low  density  problems  in  step  3  of  section  k. 

The  program  consists  of  a  main  program  and  fifteen  subroutines,  and 
may  be  conceptually  depicted  as  in  boxes  1  -  5  in  Figure  1.  Subdividing 
the  program  into  many  different  subroutines  made  it  possible  to  test 
numerous  variations  without  extensive  recoding.  However,  this  subdivision 
inevitably  slowed  the  code  somewhat  by  requiring  the  computer  to  process 
subroutine  calls  and  returns  rather  than  jump  instructions. 


1.  START 

Find  a  basic  dual  feasible  solution  to  the  problem 
and  the  row  and  column  (node  potential) 
values.  Determine  the  augmented  predeces- 


1 

sor  lists  for  the  starting  basis.  1 

2.  OPTIMALITY 

Check  for  a  variable  that  violates 
its  bounds.  If  none  exists,  stop, 
wise  pick  a  basic  variable  to  leave 
basis. 

one  of 

Other- 

the 

_ i _ 

3.  NEW ARC 

Apply  the  double  pricing  procedure  and  sim- 

Pivot  ultaneously  calculate  the  and  tt^  values. 

Process  Determine  the  incoming  nonbasic  variable. 


n - * - 1 

LOOP 

Find  the  basis  equivalent  path  (stepping  stone 
path)  associated  with  the  incoming  nonbasic 
variable  and  alter  the  flow  values  along  this  loop. 

* 

_ ; 

5.  UPDATE 

Update  the  augmented  predecessor  lists  and  the 
node  potential  values  for  the  new  basis. 

Figure  1  -  Flow  Diagram  for  the  Dual  Transportation  Code 
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The  total  time  sper.t  in  each  of  the  boxes  1-5  was  recorded  by  calling 
a  Real  Time  clock  upon  entering  and  leaving  each  of  these  functions.  A 
count  was  also  made  of  the  total  number  of  pivots  performed.  In  Tables 
1  and  2,  we  report  median  values  for  the  total  solution  time,  the  start 
time  time  spent  in  box  1),  the  number  of  pivots,  the  total  pivot  time  (total 
t^me  spent  in  boxes  2  -  5)>  and  the  average  pivot  time  (total  pivot  time 
divided  by  the  number  of  pivots).  In  addition,  Table  1  contains  the  total 
time  spent  finding  the  non-basic  arc  to  enter  the  basis  (total  time  spent 
in  box  3)  and  Table  2  contains  the  range  of  solution  times. 

In  developing  the  code  only  the  dual  start  procedure  developed  in 
Section  5  was  tested.  (Subsequent  to  our  original  development  of  this  dual 
start  procedure,  we  developed  other  dual  start  procedures  which  appear  in 
[17].) 

Three  different  criteria  were  tested  for  picking  the  basic  variable 
to  leave  the  basis.  These  criteria  were  the  first  negative  criterion, 
modified  first  negative  criterion,  and  most  negative  criterion.  The  rele¬ 
vant  tradeofis  for  the  basis  change  criteria  involve  the  time  consumed  in 
searching  for  the  variables  to  enter  and  leave  the  basis  versus  the  number 
of  pivots  required  to  obtain  an  optimal  solution  (time  per  pivot  versus 
total  number  of  pivots) . 

The  most  negative  criterion  examines  each  basic  variable  and  picks 
that  variable  to  leave  the  basis  which  violates  its  (upper  or  lower)  bound 
by  the  largest  amount. 

The  modified  first  negative  criterion  scans  the  rows  (origin  nodes)  of 
the  transportation  tableau  until  it  encounters  the  first  row  containing 
a  basic  variable  which  violates  a  bound,  and  then  selects  the  variable  in 
this  row  with  the  greatest  violation.  The  search  is  then  resumed  on  the 
1 1 ext  pivot  in  the  row  following  the  row  of  the  last  pivot. 

The  first  negative  criterion  successively  scans  the  basic  \aria!Ies 
until  it  encounters  the  first  variable  which  violates  its  bounds.  This 
variable  is  then  selected  to  leave  the  basis.  The  search  is  resumed  on  the 
next  pivot  at  the  basic  variable  following  the  one  of  the  last  pivot. 
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TABLE  1 

Total  Solution  Time  Relative  to  Basis  Cnange  Criteria 
for  250  *  250  anfi  500  x  500  Transportation  Problems 


250 

x  250  Transportation 

Problems 

MOST  NEGATIVE  CRITERION 

DENSITY 

Solution 

T  ime 

Start 

Time 

Pivot 

Time 

No.  of 
Pivots 

NEkiARC* 

T  ime/ 
Pivot 

.010 

18.604 

1.451 

17.153 

410 

8.580 

.042 

.013 

45.624 

1.853 

44.771 

900 

24.792 

.050 

.017 

52.781 

1.870 

51.911 

975 

30.369 

.053 

.020 

60.575 

1.332 

59.243 

983 

37.557 

.060 

.023 

66.401 

1.628 

64.773 

992 

43.631 

.065 

MODIFIED  FIRST 

NEGATIVE 

CRITERION 

.010 

18.315 

1.421 

16.894 

461 

8.745 

.037 

.013 

38.499 

1.812 

36.687 

861 

20.787 

.043 

.017 

40.690 

1.841 

38.849 

354 

23.460 

.045 

.020 

43.184 

1.429 

41.755 

818 

26.852 

.051 

.023 

59.865 

1.719 

58.146 

1053 

40.163 

.055 

FIRST  NEGATIVE  CRITERION 

.010 

20.671 

1.425 

19.246 

595 

12.358 

.032 

.013 

22.889 

1.843 

22.046 

852 

15.473 

.026 

.017 

31.311 

1.845 

29.466 

1005 

21 .145 

.029 

.020 

37.269 

1.396 

35.873 

1074 

26.924 

.033 

.023 

35.872 

1.675 

34.197 

907 

26.775 

.038 

500 

x  500  Transportation 

Problems 

MOST  NEGATIVE  CRITERION 

.03 

151.743 

3.013 

147.730 

1741 

70.314 

.085 

.04 

175.108 

3.794 

171.314 

1866 

36.636 

.092 

MOD 

IF I ED  FIRST  NEGATIVE 

CRITERION 

.03 

142.288 

2.916 

139.372 

2126 

78.500 

.066 

.04 

155.707 

3.860 

151.847 

2147 

85.058 

.092 

FIRST  NEGATIVE  CRITERION 

.03 

107.599 

2.944 

104.655 

2253 

73.477 

.046 

.04 

111.905 

3.927 

107.978 

2188 

77.257 

.049 

•Time  to  find  the  new  arc  entering  the  basis. 


Table  1  contains  the  resets  cf  testing  these  criteria  on  the  250  x  250 
ar.i  .00  x  500  transportation  problems.  ICot  all  the  pOO  x  yOG  transportation 
problems  vere  solved  due  to  the  fact  that  cur  results  strongly  indicated 
that  the  first  negative  criterion  was  best  for  this  problem  size.  This  was 
c-ite  surprising  since  similar  tests  for  the  primal  transportation  algorithm 
[10,20,33]  have  shown  the  modified  first  negative  criterion  to  be  preferred. 

Table  1  shows  that  more  pivots  are  required  on  the  500  x  500  problems 
as  the  simplicity  of  the  criteria  increases.  This  is  not  invariably  the 
case  for  the  250  x  250  problems.  For  the  .013  dense,  250  x  250  problem 
the  number  of  pivots  is  larger  for  the  most  negative  and  modified  first 
negative  criteria  than  for  the  first  negative  criterion.  Specifically, 
the  superiority  of  the  first  negative  criterion  strictly  improves  as 
densit;  increases.  This  seems  somewhat  peculiar  since  a  change  in  aensity 
does  not  affect  the  number  of  basic  variables.  A  partial  explanation  of 
this  result  is  provided  by  studying  the  "NEifARC"  column.  More  precisely, 
observe  that  the  "NEWARC"  times  are  much  larger  for  the  most  negative  and 
modified  first  negative  criteria  than  for  the  first  negative  criteria. 

This  indicates  that  the  basic  variable  picked  by  the  former  criteria  have 
significantly  more  negative  .  values  associated  with  it  than  does 
the  basic  variable  picked  cy  tne  latter  criterion.  This  conclusion  is  occasioned 
t  the  fact  that  the  updated  costs  associated  with  nor. -negative  X..  values 
do  not  have  to  be  calculated.  (Recall  these  problems  are  ur"apaci*.ated.)  Ir. 
addition,  the  minimization  of  the  relevant  up  dated  costs  is  over  a  smaller  set. 
ir.  all  this  reflects  an  interesting  topolowical  propert  of  the  uasic  arcs 


NEW, ARC/n-moer  of  pivots). 

Primarily  Table  1  indicates  that  the  most  negative  and  modified  first 
negative  criteria  have  little  to  offer  by  comparison  with  the  first  negative 
criterion  since  they  require  more  search  time  to  find  the  basic  variable  to 
cave  the  oasis,  more  computation  to  determine  the  non-casic  variable  to  enter 
‘re  basic,  and  the  do  not  sub  s  tar.  t  i  all.  reduce  the  r.umcer  of  pivots. 

Table  1  indicates  tha*  as  problem  size  and/or  density  increases  "NEW  ARC" 
time  grows  disproportionately  large.  For  this  reason  tne  dual  method  is  not 
an  effective  method  l'or  solving 
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problems. 


-.3  cokput/iTICs  co:-gAP.:sc:: 


The  results  of  Table  2  demonstrate  that  the  graph  structure  of  the 
transportation  problem  does  merit  the  use  of  special  purpose  algorithms. 

The  dual  code  and  the  out-of-kilter  codes  are  at  least  20  times  faster  than 
the  OPHELIE/LP  general  simplex  linear  prograami'-g  computer  code. 

1'ne  median  times  for  the  OPHELIE/LF  code  were  derived  after  first 
conducting  a  number  of  trial  runs  to  determine  the  Lest  procedure  for 
selecting  the  next  incoming  variable.  The  trial  runs  indicated  that  30 
variables  should  be  considered  at  a  time  and,  of  these,  the  variable  asso¬ 
ciated  with  most  negative  updated  cost  should  be  selected. 

The  data  in  Table  2  also  indicate  that  neither  the  SHARE  code  nor  the 
Boeing  code  dominates  the  other  with  respect  to  solution  time.  The  solution 
times  of  the  Boeing  code,  howe/er,  appeay  to  be  more  erratic,  with  a  somewhat 
broader  range.  The  solution  times  of  the  dual  code  also  appear  to  be  more 
erra*ic  than  the  SHAKE  times.  This  characteristic  of  the  dual  code  and  the 
oeing  code  reflects  their  dependence  on  density.  Reduced  density,  as  might 
re  expected,  leads  •‘■o  definite  improvements  in  computation  times. 

The  most  mportar.t  f indirig  (and  most  disappointing  from  the  standpoint 
of  the  developments  of  Sections  3  and  M  is  the  indication  in  Table  2  that 
the  dual  code  falls  behind  the  others  for  problems  of  size  2‘0  x  2‘0  and 
larger,  although  it  is  decidedly  faster  than  the  out-of-kilter  codes  o? 
small  to  moderate  size  problems  (up  through  150  x  150).  The  primar  cause 
of  this  degeneration  of  superiority  is  the  large  amount  of  tine  recuirec 
to  find  the  variable  to  enter  the  basis.  Since  our  modification  of  the  dual 
algorithm  was  in  fact  designed  to  minimize  these  calculations,  we  conclude 
that  the  dual  method  is  not  a  competitive  "dead  start"  procedure  for  solving 
large  problems  -  i.e. ,  its  potential  value  for  large  problems  lies  in  those 
situations  in  which  an  extremely  good  dual  starting  solution  is  available. 

urther,  it  is  unlikely  that  any  minor  modifications  which  are  derived  in 
the  future  will  alter  this  conclusion.  This  conclusion  is  cased  upon  several 
factors: 
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1.  Srinivasar.  and  Thompson  1 33l  found  that  the  augmented  predecessor 
index  method  [1^]  was  twice  as  fast  as  any  of  the  other  methods  for  traversing 
and  updating  a  spanning  tree.  Thus  the  procedures  for  pricing-out,  updating 
node  potentials,  and  locating  rasis  equivalence  paths  ir.  our  code  are  based 
.per.  what  is  known,  to  be  the  most  effective  method  for  performing  these 
operations. 

2.  The  problems  usee  in  this  study  overlap  the  problems  used  in  [20]. 

This  stud:/  [20]  discloses  that  a  primal  transportation  algorithm  fen'cod  ing 
the  augmented  predecessor  index  method)  coupled  with  the  Few  Minimum  start 
rule  and  a  "modified  row  first  negative  evaluator"  rule  is  at  least  100  times 
faster  than  OPHELIE.  Further  this  method's  medlar,  solution  time  for  100  x  100 
transportation  problems  on  a  CDC  6600  computer  was  1.9  seconds  and  17  seconds 
or  1000  x  1000  problems.  Thus,  the  dual  transportation  method  would  have  to 
be  improved  approximately  '-fold  on  the  100  x  100  problems  to  match  the 
performance  of  the  primal  code.  Pursuing  the  relationship  between  the  com¬ 
putational  results  of  [20]  and  this  stud.-,  the  following  remarks  apply: 

a)  The  primal  approach  is  less  sensitive  to  densit. .  than  the  dual  and 
out-of-kilter  codes. 

b)  The  dual  start  of  Section  5  is  quite  efficient.  It  requires  only 
one -tenth  of  the  time  that  the  Vogel  Approximation  Method  requires 
to  obtain  an  initial  solution  and  requires  only  half  as  many  pivots 
to  reach  optimality. 

c)  The  inferiority  of  the  dual  method  to  the  primal  method  lies  in  the 
drastic  -..fferer.ee  in  the  time  per  pivot  of  the  two  methods.  The 
dual  method’s  time  per  pivot  is  5-6  times  larger  than  that  required 
by  the  primal. 

3.  The  problems  used  in  this  study  also  overlap  the  problems  being  used 
i*  ' A) .  The  preliminary  results  of  that  study  indicate  that  an  improvec 
version  of  the  out-of-kilter  method  coupled  with  a  staie-oi-the-art  computer 
.mplementation  is  from  -  to  12  times  faster  than  SHARE.  Thus  from  this  partial 

mparison  of  three  state-of-the-art  implementations  of  the  tiiree  fundamental 
solution  approaches  to  solving  transportation  problems  it  seems  apparent  that 
the  dual  approach  is  running  somewhat  behind  the  others.  Interestingly,  as 
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though  in  anticipation  of  this,  the  original  developers  of  the  dual  trar.spor- 
tatior.  approach  [2,3,7],  suggested  that  it  ce  used  chiefly  for  post-optimality 
t.-pe  analysis  or  in  application  to  snail  problems.  (For  examrle,  it  might 
be  a  good  algorithm  to  use  in  conjunction  with  certain  cutting  plane  or 


implicit  ir.uaeration  procedures  [31]  that  restart  from  previously  optimal 
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Footnotes 


1.  A  precise  statement  of  this  method  does  not  seem  to  exist  in  the  liter¬ 
ature  except  in  the  treatment  of  Wagner  [3^]  which  utilizes  an  explicit 
replacement  of  a  bounded  variable  by  its  associated  slack.  However,  the 
statement  given  here  is  easily  inferred  from  standard  considerations. 

In  particular,  see  the  excellent  discussions  of  such  "generalizations" 
and  "variations"  in  Jewell  [22]. 

2.  This  code  was  developed  by  F.  Glover,  D.  Kamey,  and  D.  Klingman. 
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